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Abstract 

In energy harvesting communications, users transmit messages using energy harvested from nature 
during the course of communication. With an optimum transmit poHcy, the performance of the system 
depends only on the energy arrival profiles. In this paper, we introduce the concept of energy cooperation, 
where a user wirelessly transmits a portion of its energy to another energy harvesting user This enables 
shaping and optimization of the energy arrivals at the energy-receiving node, and improves the overall 
system performance, despite the loss incurred in energy transfer. We consider several basic multi-user 
network structures with energy harvesting and wireless energy transfer capabilities: relay channel, two- 
way channel and multiple access channel. We determine energy management policies that maximize 
the system throughput within a given duration using a Lagrangian formulation and the resulting KKT 
optimality conditions. We develop a two-dimensional directional water-filling algorithm which optimally 
controls the flow of harvested energy in two dimensions: in time (from past to future) and among users 
(from energy-transferring to energy-receiving) and show that a generalized version of this algorithm 
achieves the boundary of the capacity region of the two-way channel. 

I. Introduction 

In energy harvesting communications, users transmit messages using energy harvested from 
nature In such systems, transmission policies of the users need to be carefully designed 

according to the energy arrival profiles. Recent work addresses this energy management problem 
for various energy harvesting communication settings [|4l- |fT9l . When the energy management 
policies are optimized as in P1l- [[T9l , the resulting performance of the system depends only on 
the energy arrival profiles. In this paper, we introduce the notion of energy cooperation in energy 
harvesting communications where users can share a portion of their harvested energy with the 
other users by means of wireless energy transfer [E0l - fE2l . This energy cooperation enables us 
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to control and optimize the energy arrivals at users to the extent possible. In the classical setting 
of cooperation [|23l . users help each other in the transmission of their data by exploiting the 
broadcast nature of wireless communications and the resulting overheard information. In contrast 
to the usual notion of cooperation, which is at the signal level, energy cooperation we introduce 
here is at the battery energy level. In a multi-user setting, energy may be abundant in one user 
in which case the loss incurred by transferring it to another user may be less than the gain it 
yields for the other user. It is this cooperation that we wish to explore in this paper for several 
basic multi-user scenarios, where energy can be transferred from one user to another through a 
separate wireless energy transfer unit. 

Wireless energy transfer has been recently proposed as a promising technique for a wide variety 
of wireless networking applications [|24l - [|29l . In future wireless networks, nodes are envisioned 
to be capable of harvesting energy from the environment and transferring energy to other nodes, 
rendering the network energy self-sufficient and self-sustaining with a significantly prolonged 
lifetime. Wireless energy transfer is a relatively new concept for wireless communications; 
however, it has been considered in other contexts earlier: Wireless powering of engineering 
systems by microwave power transfer technology has been used in many applications [[30l - ll32l 
for a long time, such as space missions ||3T1 and optical communications [|32l . While microwave 
power transfer is viewed as the key technology for large-scale cellular networks [|24l . recent 
advances in wireless energy transfer technology supports feasibility of wireless network design 
in smaller scales. In [[33l . [|34l . wireless energy transfer with strong inductive coupling has been 
demonstrated with relatively high efficiency over relatively long distances with small device 
sizes. Another related line of research in medical implanting applications has been presented 
in [|27l - [|29l where wireless nodes are powered by wireless energy transfer, which also use 
the wirelessly transferred energy for communications. RFID technology is another prominent 
example along this direction, where nodes harvest received energy and use the harvested energy 
(via reflection) for communication [|35l . Relying on the possibility of efficient wireless energy 
transfer, in this paper, we investigate the optimum communication schemes in multi-user systems 
with nodes that have energy harvesting and energy transfer capabilities. 

In communication systems with wireless energy transfer, energy and information flow simulta- 
neously. Motivated by this nature of such systems, the trade-off between energy and information 
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transmission has been addressed in several recent works [l36l - ll42l . Among these works, the 
one that is most pertinent to our work is [HTI . where multi-user communication systems with 
simultaneous energy and information transmission are studied. Our problem formulation captures 
a different trade-off than those studied in [|36l - [|42l since in our model wireless energy transfer 
is maintained by a separate wireless energy transfer unit, and the harvested energy source is 
independent of the received signal energy. 

In this paper, we study the offline optimal energy management problem for several basic 
multi-user network structures with energy harvesting transmitters and one-way wireless energy 
transfer. Offline throughput maximization problem has been recently investigated for various 
settings with energy harvesting transmitters in [|4l- [|T9l . In Q, transmission completion time 
minimization problem for an energy harvesting transmitter with an unlimited sized battery is 
solved, and this solution is extended to the case of a transmitter with a finite sized battery 
in [|5l by showing its equivalence to a throughput maximization problem. References Il6l- [[m 
extend the throughput maximization problem and its solution to fading, broadcast, multiple access 
and interference channels. In [fT2l - [fT5l . the end-to-end throughput maximization problem is 
solved for two-hop cooperative relay networks for various settings. Extensions of the throughput 
maximization problem for nodes with battery imperfections are considered in [[T6l . [fTTl . and 
processing costs are incorporated in [fTSl . [fT9l . 

As extensively emphasized in [|4ll- [[T9l , in energy harvesting transmitters, energy arrivals in 
time impose energy causality constraints on the transmission policies of the users. In the optimal 
policy, due to the concavity of the throughput in powers, energy needs to be allocated as constant 
as possible over time subject to energy causality constraints. In the presence of wireless energy 
transfer, energy causality constraints take a new form: energy can flow in time from the past to 
the future for each user, and from one user to the other at each time. This requires a careful 
joint management of energy flow in two separate dimensions, and different management policies 
are required depending on how users share the common wireless medium and interact over it. 
In this context, we analyze several basic multi-user energy harvesting network structures with 
wireless energy transfer. To capture the main trade-offs and insights that arise due to wireless 
energy transfer, we focus our attention on simple two- and three-user communication systems. 

First, we examine additive Gaussian two-hop relay channel with one-way energy transfer from 
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the source node to the relay node where the objective is to maximize the end-to-end throughput. 
Next, we consider the Gaussian two-way channel with one-way energy transfer, and the two-user 
Gaussian multiple access channel with one-way energy transfer. For these two channel models, 
we determine the two-dimensional simultaneously achievable throughput regions. For all three 
cases, we use a Lagrangian approach and determine the optimum transmit powers and energy 
transfer policies via the KKT optimality conditions. In particular, we develop a two-dimensional 
directional water-filling algorithm which optimally controls the energy flow in time and among 
users. As observed in [|6l, energy harvesting setting gives rise to a directional water-filling 
algorithm, where energy can flow only from the past to the future due to the energy causality 
constraints. In addition, with wireless energy transfer, at any give time, energy can flow from 
one user to the other depending on the direction of wireless energy transfer. Therefore, the 
directionality of energy flow in two separate dimensions requires careful management of energy 
over time and users. Solutions obtained in each setting yield new insights on energy cooperation 
at the battery energy level in the presence of wireless energy transfer. 

II. Tvv'o-Hop Relay Channel with One-Way Energy Transfer 

In this section, we consider a two-hop relay channel consisting of a source node, a relay node 
and a destination node as shown in Fig. [TJ The two queues at the source and the relay nodes 
are the data and energy queues. The energies that arrive at the source and the relay nodes are 
saved in the corresponding energy queues. The data queue of the source always carries some 
data packets to be delivered to the destination. The data packets sent from the source node cause 
a depletion of energy from the source energy queue and an increase in the relay data queue. 
These data packets are then served out of the relay data queue with a cost of energy depletion 
from the relay energy queue. The relay operates in a full-duplex mode, i.e., the data and energy 
queues of the relay are updated simultaneously in every slot. We assume that the data and energy 
buffer sizes are unlimited. In addition, energy expenditure is only due to data transmissions; any 
other energy costs, e.g., processing, circuitry, are not considered in this paper. There is a separate 
wireless energy transfer unit at the source node, and therefore, the source node may wish to 
share a portion of its energy with the relay node so that the relay can forward more data. 

The channels from the source to the relay and from the relay to the destination are additive 
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Fig. 1. Two-hop relay channel with energy harvesting source and relay nodes, and one-way energy transfer from the source 
node to the relay node. 

white Gaussian noise (AWGN) channels. The received signals yj. and yd at the relay and the 
destination, respectively, are given by yr = y/hlxs+ns and yd = y/h^Xr+rir, where hs and hr are 
the channel coefficients for the source-to-relay and relay-to-destination channels, respectively, 
and rir are Gaussian noises each with zero-mean and unit-variance. We assume that hg = hr = I 
without loss of generality as otherwise the energy arrivals can be properly scaled. 

Time is slotted and there are a total of T equal length slots. Without loss of generality, we 
assume that the slots are of unit length. At times t = 1, . . . , T, the source harvests energy with 
amounts Ei, E2, . . . , Et and the relay harvests energy with amounts Ei, E2, . . . , Et- Energy 
transfer efficiency is a, where < a < 1. This means that when the source transfers 5i amount 
of energy to the relay through the wireless energy transfer unit in slot i, a6i amount of energy 
enters the energy queue of the relay in the next slot. Similarly, when the source uses power Pi 
for data transmission, the data queue of the relay is increased by | log (1 + Pi) bits in the next 
slot. The source and relay slots are indexed by one slot delay, so that, the slot subscripts are 
aligned at the source and the relay; see Fig. |2] Power policy of the source is the sequences Pi 
and 6i, and the power policy of the relay is the sequence Pi. 

As the energy that has not arrived yet cannot be used for data transmission or energy transfer, 
the power policies of the source and the relay are constrained by the causality of energy in time. 
These constraints yield the following feasible set: 

^={(5,P,P): J]F, <^(i?,-<5,), <5^(^. + a5,), E^^^E^- 

(1) 
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where vectors P, P and S denote sequences F,, Pi and 6i, respectively. is the feasible set due to 
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Fig. 2. Slotted system model: The queues of the relay are updated with one slot delay with respect to the queues of the source 
so that the slot indices are aligned. 

energy causality in harvested and transferred energies and is valid for the two-way and multiple 
access system models as well. For the two-hop relay channel model, we have an additional 
constraint: The relay transmits data that arrives from the source. Therefore, the power policies 
of the source and the relay need to satisfy the following data causality constraints at the relay: 

J2l^og{l + P,)<J2l^og{l + Pi), k = l,...,T (2) 

i=l i=l 

We formulate the end-to-end throughput maximization problem in the next section. 

in. End-to-end Throughput Maximization for the Relay Channel 

The optimal offline end-to-end throughput maximization problem with wireless energy transfer 
subject to energy causality at both nodes and data causality at the relay node is: 

^ 1 

max V - log (1 + Pi) 

Pi, Pi, Si ^2 
1=1 

k , k 



S.t. ^llog(l + A)<^ilog(l + P,), fc = l,...,T 

i=l i=l 

(5,P,P)e^ (3) 



It can be shown that ([3]) is equivalent to a convex optimization problem (see [tlQl ). by a change 
of variables from Pj, Pj, 5i to f j = ^ log (l + Pj) , = | log (1 + Pj) , 5i. Thus, ^ can be solved 
using standard techniques Il43l . The Lagrangian function for the problem in (|3]) is: 

T T / k k 



£ = - 5^1og(l + P.) + 5^ aJ ^log(l + P.) - 5^1og(l + P.; 

1=1 k=l \i=l i=l 

T / k \ T / k \ 

+ X]/uJ^P.-(P.-'5,) ) ^P,-(^, + a5,) ) -$^Pfc4 (4) 



k=l \i=l / k=l \i=l / k=l 



Lagrange multiplier pk is due to the constraint that 5^ > 0. Note that the same constraints apply 
for Pi and Pj; however, Pj and Pi are always non-zero in the optimal policy, therefore we exclude 
them. Similarly, we exclude the constraints Y^\=i — Yli=i the Lagrangian function as 
these constraints can never be satisfied with equality in the optimal policy. This is because, if 
the source transfers all of its arrived energy at some slot, then the relay will have no data to 
send at that slot, and allocating a small portion of the arrived energy for source transmission 
strictly increases the throughput in this case. The KKT conditions for this problem are: 
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with the additional complementary slackness conditions as: 

k k 
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From dS]), © and © we get: 



k=i k=i 

Next, we obtain necessary optimality conditions for (|3]). 



(5) 
(6) 



^/ifc - a^77fc - Pi = 0, (7) 



A,. (^log(l + P,)-$^log(l + P.) =0, VA; (8) 

,i=i i=i J 

^ik(^^P^-{E,-S,)^ =0, Wk (9) 

J2n-{E, + aSi)j =0, yk (10) 

Pfc4 = 0, VA: (11) 



p_iEfc=^_l^ Vz (12) 

l^k=i Vk 

p. = ^fe=^ ^ - 1, Wi (13) 

T T 

pi =^^J'k - a^rjk, \/i (14) 



8 

A. Necessary Optimality Conditions 

The first necessary optimality condition for (|3} is that the source has to send as many bits as 
the relay can send and the relay has to finish up all the data in its data buffer. In other words, 
in the optimal policy, no data should be left in the data queue of the relay at the end. 

Lemma 1 The optimal power sequences P*, P* must satisfy the constraint YlJ=i \ log(l+-Pi*) = 

Ef=aiog(i + ^*). 

Proof: Suppose the stated constraint is satisfied with strict inequality. Then, we can increase 
some 5i, increase Pi and decrease Pj without violating the energy constraints and improve the 
overall throughput which contradicts the optimality of P*, P*, S*. ■ 

We note that if the relay energy profile is sufficient to forward all the bits in the optimal 
source data stream with respect to the source energy profile, that is, if the separable policy in 
lfT2]| . [fT3l yields a policy that satisfies the necessary condition in Lemma [B then it is the optimal 
solution for (|3]) and no energy transfer is needed. 

The second observation about the optimal policy is that the source has to exhaust the energies 
that have been harvested throughout the communication session either for data transmission or 
in the form of wireless energy transfer. 

Lemma 2 The optimal power profiles P*, P* and energy transfers 6* must satisfy Yli=i — 

Proof: Suppose this constraint is satisfied with strict inequality. Then, we can increase some 
5i and then increase Pi and Pi to achieve a larger throughput and satisfy the constraints of dS]). 
This contradicts the optimaUty of P*, P*, 6*. ■ 
Next, we observe that if there is a non-zero energy transfer from the source to the relay, then 
the relay has to exhaust all of its energy in the optimal policy. 

Lemma 3 For the optimal power sequences P*, P* and energy transfer sequence 6*, if S* ^ 
for some %, then J^t, P* = Etii^i + a6*). 

Proof: Suppose this constraint is satisfied with strict inequality. Using a similar argument 
as in Lemma [21 we can decrease Si and increase Pi to achieve a larger throughput and satisfy 
the constraints of problem (|3]l. This contradicts the optimality of P*, P*, S*. ■ 
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Finally, we note that, in the optimal policy, the total energy expenditure at the relay must be 
higher than the total energy expenditure at the source. 

Lemma 4 The optimal power sequences P* and P* must satisfy X]i=i — J2i=i ^i' ^'^^ ^'^^ 
equality if and only if P* = P* for all i. 

Proof: We will give a proof based on majorization theory and Schur convexity f44^. We 
denote the optimal source and relay rate allocation vectors as r* = [r^,...,r^] and r* = 
[fl, . . . , f^], where r* = | log (1 + P*) and f* = ^ log (1 + P*), for z = 1, . . . , T. First, we note 
that the optimal rate allocations of both the source and the relay are monotone non-decreasing 
sequences by [[4, Lemmas 1 and 4], i.e., r* < r*^-^ and f* < f*j_]^, for i = 1, . . . ,T. Second, we 
note the data causality constraint at the relay Yli=i ^1 — Yl'i=i ^j*' ^r all k < T, and the equality 
Yyi=i = Yli=i '"i* by Lemma [U These imply that r* is majorized by r*, which is denoted by 
r* ^ r*; see [44, Definition l.A.l]. Since P* = 2^'"-* — 1 and g{x) = 2^^ — 1 is strictly convex, 
Ei=i P* = Ei=i 2^''' - 1 is a strictly Schur convex function of r* p4]. Proposition 3.C.1]. 
Then, since r* ^ r*, we have that Ef=i ^* = Ef=i 2'"' - 1 < Ef=i 2''»* - 1 = Ef=i ^* 61 
Proposition 4.B.1]. Moreover, due to the strict convexity of g{x), and the resulting strict Schur 
convexity, equality is possible only when r* = f* for all i. ■ 
An immediate application of Lemma |4] is that if Yli=i < Yli=i i-^-' if the total energy 
of the relay is less than the total energy of the source, then the relay cannot forward the source 
data stream only with its own energy. In this case, we must have S* ^ for some i, i.e., some 
energy transfer is strictly needed. We state this in the following lemma. 

Lemma 5 If the data buffer of the relay is empty at some slot k, k < T, then Ei=i ^ 
Ei=i Pi' with equality only when P* = P* for all i = 1 , . . . , k. 

Proof: If the data buffer of the relay is empty at some slot k, k < T, then we must have 
Ei=i ^ Ei=i ^i- Together with the data causality constraints at the relay Ei=i — Yli=i '"'t^ 
for A; = 1, . . . , A; — 1, we conclude that the subvector = [rjf, . . . , r^] is majorized by the 
subvector r* = [rj, . . . , r*], i.e., r* < r*. Then, Eli ^ = Eli 2^^* - 1 < Eli 2^^* - 1 = 
Ell -^i*' ^''^^ with equality iff r^, = due to the strict Schur convexity. ■ 
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Necessary conditions in Lemmas \T\ through |5] do not provide detailed structural properties 
for the optimal policy for an algorithmic solution. In the next sections, we consider specific 
scenarios to gain insight on the optimal policy. In particular, we examine cases that correspond 
to practically interesting settings, such as the case of only one of the nodes harvesting energy. 

B. Specific Scenario: Relay Energy Higher at the Beginning Lower at the End 

We consider the scenario where the relay energy arrival profile is higher at the beginning, 
intersects the energy arrival profile of the source once, and remains lower until the end of the 
communication, as shown in Fig.[3l In particular, we assume that there exists i E [0, T] such that 
ELi Ek > ELi Ek, for alH = 1, . . . , i, and Yll=i Ek < ELi -Efc, for alH = z + 1, . . . , T. 
In Fig. [3l z = 3. We note that this case also covers the setting where the relay is not energy 
harvesting, and only the source harvests energy during the communication session. 

For this case, we propose the following solution. Form a new energy arrival profile as: 
min{Efc=i ^''a+f'' ' Efc=i Ek} as shown in Fig. [3l and maximize the throughput with respect to 
this profile. In particular, use EI=i £^fc for z = 1, . . . , z, and El=i ^''a+f'' for z = z + 1, . . . , T; 
and perform energy transfer only at slots i + . . . ,T. The resulting power sequences are matched 
for the source and the relay. More specifically, we propose 

p* = p: = — ^ (15) 

rii - rii^i 

where 

; } (16) 

k — rii^i 

We next show that there exist \i, fii,r]i, pi > that satisfy (|5l)- (fTT)) and yield the solution in 
([l5])-([l6l) via ([nj-dlll). In particular, = and 77^ = ^ for z = ^ + 1, . . . , T. Since a Ylk=i Vk = 
Efe=i /^fc for all z = z + 1 . . . , T, we have from (fT2l) and (fTJt 

P* + aP: = —^ + z = z + l,...,T (17) 

l^k=i ^fc 

Hence, P* = -4=rr 1, which implies that At = tt— and Aj = for z = z + l,...,T — 1. 

Moreover, rji = ^ > whenever Efc=i ^''a+i'' active for some z = z + 1, . . . , T. As in [[6]|, 
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Fig. 3. Optimal power sequence and energy transfer when the relay energy profile is higher at the beginning and lower at the 
end with crossing only once. 

IITI, we can show that such Vi = ^ that yield the power sequence in (fT5l) -(fT6]) are uniquely 
found for i = z + 1, . . . , T. 

It remains to find the Lagrange multipliers for i = 1,. . . ,i. We observe that r]i = and 
Pi = Ylk=i /^fc for z = 1, . . . , i That is, the relay power constraint is not active in the first i slots, 
Z]fc=i < Z]fc=i ^k, i = I, . . . ,i. To justify this claim, we note that since P* = P* for 
z = I + 1, . . . , T, we have Y!i=i i log (1 + P*) = ELi I log (1 + P*)- By Lemma [5l selecting 
Pi = Pi for i = l,...,z is the minimum energy consuming policy at the relay. Since by 
assumption J2k=i < X]I=i ^k for z = 1, . . . , z, Pj = Pj is feasible and hence optimal, which in 
turn implies that Y!k=i ^k < ELi -E^ for z = 1, . . . , z. As a consequence, Yl=i Vk = ZLi+i Vk, 
i.e., constant for all z = 1, . . . , z. As P* < P*^^ we can specify < Aj < recursively, with 
Aj > only when J2k=i ^k constraint is active, as follows 

T T 

Xi = i-p* Vk- J2 (18) 



k=i+l 



k=i+l 



Moreover, /ij > for slots where J2k=i ^k constraint is active and fii 



Z^k=i+1 f^k- 



Note that if S* ^ for some i, the optimal source and relay power sequences are unique while 
there may exist infinitely many S* that yield the same optimal power levels. 

A particular case covered is when only the source has energy replenishments and the relay has 
all its energy available initially, i.e., -Ei > and = for i > 1. If Ei > Ylf=i relay 
can forward all the bits sent from the source and the optimal policy is trivial. If Pi < Yli=i 
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Fig. 4. Optimal power sequences and energy transfer when the source energy is available at the beginning. 



the optimal policy is obtained by forming a common energy profile via energy transfer and 
matching the power and rate sequences. Another special case is when i = 0, i.e., when Ei < Ei 



for all i. In this case, mm{Y!k=i %rf^' Y!k=i ^k} = EI=i "t'+i^" for all i and matching the 



Ei > Ei, Wi. The source optimizes the throughput according to {Ei}J^^ and the relay power is 
matched with the source. 

C. Specific Scenario: Source Energy Available at the Beginning 

We consider the scenario where the source has all of its energy available at the beginning 
(i.e.. El > only), and the relay harvests energy throughout the communication. Let the relay 
energy profile not be satisfactory to forward the optimal source data stream which has constant 
rate |log(l + -|f). Assume 5i for some i. Since the source is not energy harvesting, the 
total energy of the source will then be Ei — 6i yielding an optimal transmission power of 
Hence, the throughput of the source is independent of the slot index i the energy is transferred. 
However, transferring the energy at slot j < i can only increase the relay transmit powers after 
that slot; therefore, energy transfer has to be performed as early as possible, i.e., at the first slot. 
Hence, the jointly optimal policy is 5* 7^ and 5* = for the remaining slots as shown in Fig. 
m Note that the power sequences of the source and the relay are not matched. §1 is found by 
solving a fixed point equation as: 



relay and source power sequences is optimal with 6* = Ei 



When I = T, we have 

a+l 




(19) 
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where f{Ei, E2, . . . , Et) is the maximum number of bits corresponding to the energy arrival 
sequence Ei, E2, . . . , Et- 

IV. Gaussian Two-Way Channel with One-Way Energy Transfer 

In this section, we consider a two-way channel as shown in Fig. [51 The two queues at the 
nodes are the data and energy queues. The energies that arrive at the nodes are saved in the 
corresponding energy queues. The data queues of both users always carry some data packets. 
The physical layer is a memoryless Gaussian two-way channel ll45l where the channel inputs and 
outputs are xi, and y\, y2, respectively. The input-output relations are yi = xi+X2 + ni and 
y2 = Xi + X2 + n2 where rii and n2 are independent Gaussian noises with zero-mean and unit- 
variance. In slot t, the first and second users harvest energy in amounts Et and Et, respectively. 
There is a separate wireless energy transfer unit at the first user, that transfers energy from the 
first user to the second user with efficiency < a < 1. The power policy of user 1 is composed 
of the sequences Pi and 5j, and the power policy of user 2 is the sequence Pi. 

For the Gaussian two-way channel with individual power constraints Pi and P2, rate pairs 
R2) with Ri<\ log (1 + Pi),R2 <\ log (1 + P2) are achievable 145]. For a fixed energy 
transfer vector 6, and feasible power control policies P and P, the set of achievable rates is: 

T T 

C,(P,P) = {(/?i,i?2): i?i<5^-log(l + P.), R2<Y,-\og{l + Pi)] (20) 

1=1 1=1 

The notation shows the dependence of the region on the energy transfer vector 5. This region 

is shown in Fig. [6] for different values of 5. Each of these regions are rectangles of the form 

Ri < Ci where Ci is the maximum throughput achieved for user i found by maximizing (|20|) 

constrained to the feasibility constraints J^. As 6 is increased, energy is transferred from user 1 

to user 2 therefore Ci decreases while C2 increases. By taking the union of the regions over all 

possible energy transfer vectors and power policies for the users, we obtain the capacity region 

of the Gaussian two-way channel as: 

C(E,E)= U C5(P,P) (21) 

((5,P,P)gJ' 

We determine the capacity region of the Gaussian two-way channel in the next section, by 
solving weighted rate maximization problems which trace the boundary of the capacity region. 
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Fig. 5. Two-way channel with one-way energy transfer. 



V. Capacity Region of the Gaussian Two-Way Channel 

In this section, we characterize the capacity region as well as the optimal power allocation and 
energy transfer policies. We start by noting that the capacity region is convex in the following 
lemma. The proof of this lemma is provided in Appendix lAl 

Lemma 6 C{E,E) is a convex region. 

Since C(E, E) is convex, each boundary point can be found by solving the following weighted 
rate maximization problem: 

T 



max J2 ^4 log (1 + + ^4 + 



i=l 

S.t. (5,P,P)gJ' 



(22) 



The problem in (|22|) is a convex optimization problem as the objective function is concave and 
the feasible set is a convex set ll43l . We write the Lagrangian function for (|22] | as: 

T T / k 



i=l k=l \i=l 

T / k \ ^ 

+ ^?7J + (23) 

k=l \i=l ) k=l 

where we do not include constraints Yli=i — J2^i=i since these constraints can never be 
satisfied with equality in the optimal policy for the Gaussian two-way channel for 61,62 > 0, 
as that would require Pi = for some i, which is suboptimal. Zero powers are optimal only in 
the degenerate case 61 = 0, which corresponds to maximizing R2, whose solution is point 3 in 
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Fig. 6. Capacity region of the Gaussian two-way channel. 

Fig. [6l The KKT conditions for this problem are: 



T 



k=i 

^ ^ k=i 
T T 

^/ifc - a^?7fc - Pi = 0, Vz 



fc=i A;=i 

with the additional complementary slackness conditions as: 

l^k ^^P^-{E,-6,)j =0, Wk 



Pk6k = 0, \/k 



From (EH), (125]) and ^ we get: 



Pi 



jT^ 1, Vi 

02 



2^k=i Vk 



1, Vz 



(24) 
(25) 
(26) 



(27) 

(28) 
(29) 



(30) 
(31) 

(32) 
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We will give the solution for general 6'i, ^2 > in the sequel. Before that, we note that in the 
extreme case when 62 = 0, the problem reduces to maximizing the first user's throughput only 
and hence any energy transfer is strictly sub-optimal, i.e., 5 = is optimal. This corresponds 
to point 1 in Fig. [6l Similarly, when Oi = 0, the problem reduces to maximizing the second 
user's throughput only and the first user must transfer all of its energy to the second user, i.e., 
5 = E is optimal. This corresponds to point 3 in Fig. |6l When 61,62 > 0, we obtain the points 
between points 1 and 3 in Fig. [6l In this case, for a given energy transfer profile Si, . . . ,St, the 
optimization problem can be separated into two optimization problems, each only in terms of 
the power control policy of the corresponding user. For fixed 6, the optimal power policies of 
the two users can be found by flU. 

Next, we provide the necessary optimality condition for a non-zero energy transfer. 

Lemma 7 For the optimal power sequences P* , P* and energy transfer sequence 6*, if 6* 7^ 
for a slot i, then 

^ - ^ (33) 

1 + P: 62a 

Proof: From dlB and we have 

1 + P: _ 6iY.l=rrik 



(34) 



l + Pt 62{aZL.Vk + P^] 
If there is a non-zero energy transfer, S* ^ 0, we have from (|29] ), pi = 0. Therefore, (|33T ) must 
be satisfied if S* ^ 0. ■ 

In order to devise an algorithmic solution, we apply a change of variable Pi = ^ and re-write 
the optimization problem in terms of Pi, Pi, 6i as follows: 

T 



max Vei^log(l + Pi) + ^2^1og(l + aPi) 

k k 

S.t. ^P, <5^(£;,-(5,), VA; 

i=l 1=1 
k ^ / P \ 

i=l 1=1 ^ ^ 

k k 



i=l 1=1 
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The optimal power allocation for this problem is: 



1 



(36) 



p* 

i 



02^1 , Vz 



a 



(37) 



where z/j and Vi in slot i are defined by 



1 



1 




and Vi 



(38) 



The power level expressions in (|36]|-(|37T) lead to a directional water-filling interpretation 
In particular, we note that energy has to be jointly allocated in time and user dimensions together. 
This calls for a two-dimensional directional water-filling algorithm where energy is allowed to 
flow in two dimensions, from left to right (in time) and from up to down (among users). We, 
next, explain this algorithm. 

A. Two -Dimensional Directional Water-filling Algorithm 

We utilize right permeable taps to account for energy which will be used in the future and 
down permeable taps to account for energy that will be transferred from user 1 to user 2; see 
Fig. Ill We note from the KKT conditions that Vi = Vi in slots where there is non-zero energy 
transfer. Note that in the original problem, this implies that if some energy is transferred, then 
the power levels in that slot need to satisfy (|33] ). The base levels for users 1 and 2 are 1 and ^, 
respectively. Moreover, to facilitate the water flow interpretation, we scale the energy arrivals of 
user 2 by ^ as seen in (l35l) . If the resulting water levels are higher for user 1 or not monotonically 
increasing in time for both users, then water has to flow until the levels are balanced. 

While finding the balanced water levels, the two dimensions of the water flow (i.e., in time 
and among users) are coupled and therefore it is not easy to determine beforehand which taps 
will be open or closed in the optimal solution. In particular, the water flow of user 2 from time 
slot i to time slot i + j, j > 0, may become redundant if some energy is transferred from user 
1 in time slot i + j. To circumvent this difficulty, we let each tap (right/down permeable) have 
a meter measuring the water that has already passed through it and we allow that tap to let the 
water flow back if an update in the allocation necessitates it. This way, we keep track of the 
source of the energy and whether it is transferred to future time slots or to the other user. First, 



18 



OFF 



User 1 



User 2 



1 
0¥¥( 1 



2 

OFF 



OFF 
'0^ 



1 2 

before 



ON 



ON 

© 



1 2 

|()FF 



ON 



(I 

ONI 



ON 
"TP 



(I 1 2 

after 



Fig. 7. Two-dimensional directional water-filling with right/down permeable meter taps for a two slot system. 

we fill energy into the slots with all taps closed. Then, we open only the right permeable taps 
and perform directional water-filling (over time) for both users individually [6]. Then, we open 
the down taps one by one in a backward fashion. If water flows down through a tap, the amount 
is measured by the meter. Water levels in the slots connected by the bi-directional horizontal 
taps need to be equal. Whenever water flows down through a down permeable tap, the water 
levels must satisfy the proportionality relationship in d33l) . When the water levels are properly 
balanced, the optimal solution is obtained. 

An example run of the algorithm is given in Fig. |7] for 9i = 62 and a = 1. Initially, we 
open the right permeable taps and the water levels are equalized for the first user. Then, we 
open the down permeable taps. In the second slot there is no need for energy transfer because 
^i^tEz < £"2. In the first slot there will be some non-zero energy transfer since -^liS. > jt]^^ and 
some water flows through the first down permeable tap. Since user I's right permeable tap has a 
positive meter at that point, some water is allowed to flow from right to left thereby equalizing 
the water levels of user I's first and second slots and user 2's first slot. 



B. A Specific Run of the Algorithm 

In order to show more specifically how the algorithm runs and further justify the particular 
sequence of steps followed in the two-dimensional water-filling algorithm, we next provide a 
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numerical example where E = [0, 12,0] mJ, E = [6,6,0] mJ and a = 1. Tu, denote the 
horizontal taps of the first and second users connecting the zth and z + 1st slots, Qi denotes 
the ith vertical tap. The optimal solution is P = [0,4.8,4.8] and P = [4.8,4.8,4.8], which is 
obtained by spreading the energy as equally as possible in two dimensions among the users and 
time slots, subject to energy causality. In order to understand why the particular order of tap 
openings is optimal, we next consider two sub-optimal orderings of tap openings. 

Assume that we open the horizontal taps first and keep the vertical taps closed. This yields 
the transient water levels P = [0, 6, 6] and P = [4, 4, 4]. Now, if we open the vertical taps, water 
is transferred in the second and third slots and the balanced final levels are P = [0,5,5] and 
P = [4, 5, 5]. This profile is not optimal since the second user changes its power level when the 
battery is non-empty, violating dH Lemma 2]. 

Now, assume that we open the vertical taps first and keep the horizontal taps closed. Energy 
is transferred in the second slot and the new transient water levels will be P = [0,9,0] and 
P = [6,9,0]. Then, when we open the horizontal taps, we will have P = [0,4.5,4.5] and 
P = [5, 5, 5]. This profile is not optimal either, as after energy transfer, the source power level 
is less than the relay power level, violating Lemma |7] 

We now show how the two-dimensional directional water- filling algorithm works. First, we 
open the horizontal taps to get P = [0,6,6] and P = [4, 4, 4] with the water meters reading [0, 6] 
and [2, 2]. Recall that the taps with positive meter readings allow bi-directional energy transfer. 
Next, we open the vertical taps in a backward fashion. Once Qz is opened, water flows to the 
second user and since T21, T22 are bi-directional it starts to fill all the slots of the second user. 
A balance is established when P = [0,4.8,4.8] and P = [4.8,4.8,4.8], which is the optimal 
solution. 

VL Multiple Access Channel vv'ith One-Way Energy Transfer 

In this section, we consider the multiple access channel scenario shown in Fig. [8l In the 
multiple access channel, the received signal h y = xi + X2 + n where xi and X2 are signals of 
user 1 and user 2, respectively, and n is a Gaussian noise with zero-mean and unit-variance. For 
the Gaussian two-user multiple access channel with individual power constraints Pi and P2, rate 
pairs R2) with i?i < 1 log (1 + Pi), i?2 < I log (1 + P2), Ri + R2 < \ log (1 + A + P2) 
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Fig. 8. Multiple access channel with one-way energy transfer. 

are achievable [|46l . For a fixed energy transfer vector 6, and feasible power control policies P 
and P, the set of achievable rates is a pentagon defined as [[TOl : 

T 



Cs(P,P) 



{(/2i,i?2):i?i<^^log(l + Pi), 

i=l 

R2<J2-log{l + P,), 

i=l 
T 



(39) 



For each feasible (P, P, 5), the region is a pentagon. We obtain the capacity region by taking 
the union of these regions over all feasible power allocations and energy transfer profiles: 



C(E,E)= (j C,(P,P) 



(40) 



We determine the capacity region of the Gaussian multiple access channel in the next section. 

VII. Capacity Region of the Gaussian Multiple Access Channel 

In this section, we characterize the capacity region as well as the optimal power allocation 
and energy transfer policies. First, we note in the following lemma that the capacity region is 
convex. We prove this lemma in Appendix |Bl 

Lemma 8 C{E,E) is a convex region. 

Since the region is convex, each boundary point is a solution to max^gc*^ [|47l for some 
6 = [9i, Q-2\. We examine two cases separately, 9i > 62 and 9i < 62- 
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A. Oi > 02 

We show that when 6i > 62, no energy transfer from user 1 to user 2 is needed. Note that as 
9i > 02, the boundary points between 1, 2 and 3 in Fig. [9] are found by solving the problem: 

T 

max - 02)1 log (1 + P.) + 02^ log (1 + P. + P.) 

1=1 

s.t. (5,P,P) G J" (41) 

The problem in (|4TI) is a convex optimization problem as the objective function is concave and 
the feasible set is a convex set H3l . We write the Lagrangian function for (1411 as: 



T T / k \ 

- [(^1 - ^2)l0g(l + P.) + ^2 log (1 + P. + P^)\ + ^P. - - 

i=l k=l \i=l / 

k=l \i=l / k=l \i=l J k=l 

where we now included the constraints Yl'i=i — Yli=i ^i- The KKT conditions are: 

0^ — 00 00 V — -\ 

k=i 

-irlrTr +5: = « (44) 

k=i 

T T T 

^/ifc - a^77fc + ^7fc - Pi = 0, Vz (45) 

Since 6i > 02, from (|431)-(|44]|. we have Ylk=il^k > Ylk=iVk, vvhich is satisfied with equality iff 
01 = 02- This together with ([45] ) implies that pi — Ylk=ilk > 0, which is satisfied with equality 
iff 01 = 02 and a = 1. Therefore, unless we have exactly 0i = 02 and a = 1, we must have 
Pi > for all i. This together with the complementary slackness conditions pk5k = implies 
that we must have Si = for all i, i.e., no energy transfer is needed. However, when 0i = 02 and 
additionally if a = 1, then there may exist multiple different optimal energy transfer profiles, 
including the one with no energy transfer. 

Since energy transfer is not needed, optimal power control policies for the two users are the 
same as those in the energy harvesting multiple access channel with no energy transfer and can 
be found by the generalized backward directional water-filling algorithm described in [[TOl . That 
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Fig. 9. Capacity region of the Gaussian multiple access channel for a = 1 and a < 1. 

is, the capacity region boundary from point 1 to point 3 in Fig. [9] is found by the algorithm 
in IfTOll . Specifically, for 9i = 02, we have rj^ = fik for all k and the sum-rate optimal power 
policies are obtained by applying single-user directional water-filling algorithm to the sum of 
the energy profiles of the two users [ilOl . 



B. 01 < 02 

Here, we consider the remaining parts of the boundary, namely the points from point 3 to 
point 4 in Fig. |9l In this case, we need to solve the following optimization problem: 

T 



max y{02 - ^i) log (1 + Pi) + 01 log {1 + Pi + Pi) 

p. p. K. ^ ^ 

1 = 1 

s.t. ((5, P, P) e J" 



(46) 



which is a convex optimization problem and the corresponding KKT conditions are: 

T 



l + P^ + P^ 



'1 



02 — 01 



1 + Pi 1 + P, + Pi 



T 



T T 



k=i 
T 



k=i 



^ /ifc - a ^ ?7fc + ^ 7fc - A = 0, Vz 



(47) 
(48) 
(49) 



We do not have an analytical closed form solution for (l47Tl-(|49l). Since (|46|) is a convex opti- 
mization problem, standard numerical methods for convex optimization may be employed. We 
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find that the solution of (|46|) has a simple form in some special cases, which we investigate next. 

When a = 1, we find that the optimal solution of ( |46l ) requires all the energy of user 1 
transferred to user 2. To verify this fact, we note from (|47T)-(|48T) that r]T > fJ-r, since 02 > 9i. 
Combining this with (|49l) . we obtain ■Jt — Pt > 0. Note that if XlLi ^* < Yli=i then 
Jt = Q and hence px < 0, which is not possible. Thus, in the optimal solution, we must have 
Y^J^i Si = Yli=i ^i- Therefore, user 1 should not transmit any data, and instead should transfer 
all of its energy to user 2 by the end of T slots. This policy corresponds to point 4 in Fig. |9l 
On the other hand, sum-rate optimal point, point 3, achieves the same throughput as point 4. 
This implies that when a = 1, points 2, 3 and 4 in Fig. [9] lie on the 45° line. In particular, the 
optimal throughput of user 2, which is obtained by single-user throughput maximization subject 
to harvested energies of user 2 plus the harvested energies of user 1, coincides with the optimal 
sum-throughput. 

When a < 1, points 3 and 4 in Fig. |9]are not on the same line. We observe that when |^ is 
sufficiently large, user 1 transfers all of its energy to user 2. In order to verify this claim, we 
note that, if user 1 transfers some but not all of its energy at the end of T slots, then 7^ = 0. 
In this case, from (I47l)-(l49l) and as pr > 0, we have 

1 + Pt 0(62 - 6*1) 

> -7^ TTT^ (50) 



1 + Pt + Pt ~ (1 - a)9i 
Since , < 1, we conclude that if "[^^ > 1, then (l50l) cannot be satisfied which forces 

I+Ft+tt [l—ctjai — ' ^ ' 

all of the energy of user 1 to be transferred to user 2 so that 7t > 0. Note that ""IflJ^Q^^ > 1 is 
equivalent to |^ > ^. Hence, if ^ > ^, in the optimal solution, user 1 transfers all of its energy 
to user 2. This implies that the capacity region boundary intersects the horizontal line in Fig. |9] 
with slope less than or equal to -. 



VIII. Numerical Results 

In this section, we provide numerical examples for the multi-user settings studied and illustrate 
the resulting optimal policies. In all examples, we assume that the slot length is 1 second, noise 
spectral density is A^o = 10"^^ W/Hz and the available bandwidth is 1 MHz. Moreover, path 
loss of each link in each model is set to 100 dB for convenience. 
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A. Numerical Example for the Gaussian Two-Hop Relay Channel 

We first consider the two-hop relay channel with energy harvesting and energy transfer in 
Section [III In our first numerical study, the source and the relay have the energy arrival profiles 
E = [2; 3; 5; 4] mJ and E = [5; 1; 2; 1] mJ, respectively, and the wireless energy transfer efficiency 
is a = 0.5. We note that for these energy harvesting profiles the relay energy profile is higher 
at the beginning and lower at the end with crossing only once in the third slot. Therefore, the 
resulting optimal rate profiles are matched in the optimal policy. An optimal energy transfer 
vector is (5 = [0;0; 1.33; 3.33] mJ and the resulting optimal power allocation vectors after the 
energy transfer are P = P = [2; 3; 4; 6.33] mW. We note that while the optimal energy transfer 
profile is not unique, resulting optimal powers are unique. 

Next, we change the energy arrival profiles for the source and the relay as E = [12; 0; 0; 0] 
mJ and E = [5; 1; 0; 2] mJ, respectively, with energy transfer efficiency a = 0.5. Note that the 
source node is not energy harvesting. In this case, we find the optimal energy transfer vector as 
S = [2.67; 0; 0; 0] mJ and the resulting optimal power vectors are P = P = [2.33; 2.33; 2.33; 2.33] 
mW. Note that the optimal power sequences for the source and the relay match in this specific 
example, which does not hold in general. 

B. Numerical Example for the Gaussian Two-Way Channel 

In this section, we consider the Gaussian two-way channel model in Section |IVl The energy 
arrival profiles of user 1 and user 2 are E = [5; 10; 5] mJ and E = [10; 5; 10] mJ, respectively, 
and the wireless energy transfer efficiency is set to a = 0.7. We found the capacity region 
by running the two-dimensional directional water-filling algorithm for all 61,62 > 0. We plot 
the resulting capacity region in Fig. [TOl where we also plot the capacity region when energy 
transfer is not allowed. Note that when energy transfer is not allowed, the capacity region is 
the rectangle with single-user optimal rates subject to the individual energy arrivals. We observe 
that the availability of wireless energy transfer significantly improves the capacity region. 

C. Numerical Example for the Gaussian Multiple Access Channel 

In this section, we consider the Gaussian multiple access channel model in Section |Vll The 
energy arrival profiles of user 1 and user 2 are E = [5; 2; 5] mJ and E = [1; 3; 1] mJ, respectively. 



25 



4 



2 













































































With energy transfer 
- - - Without energy transfer 





(I , , , i !^ ■ 1 

2 4 6 8 10 12 

Rg (Mbits) 



Fig. 10. Capacity region of the two-way channel with energy transfer. 

and wireless energy transfer efficiency is a = 0.5. We plot the resulting capacity region in Fig. [TT] 
and we compare it with the region when no energy transfer is allowed. Note that when no energy 
transfer is allowed, the region is found by the backward directional water-filling algorithm in 
IfTOll . We observe in Fig. [TTIthat the boundary of the capacity regions when energy transfer is 
allowed and not allowed match when the priority of user 1 is higher than the priority of user 2. 
However, the availability of wireless energy transfer significantly improves the capacity region 
when priority of user 2 is higher than the priority of user 1 . 

IX. Concluding Remarks 

Energy cooperation made possible by wireless energy transfer is a fundamental shift in 
terms of the energy dynamics of a wireless network, yielding new performance limits. In 
this paper, we studied the communication performance of simple two- and three-node wireless 
networks in a deterministic setting where nodes harvest energy from the environment and wireless 
energy transfer is possible from one user to another in one-way and with efficiency a. We 
first considered the Gaussian two-hop relay channel and studied the end-to-end throughput 
maximization problem. We showed that if the relay energy profile is higher first and then lower, 
the rates of the source and the relay nodes need to be matched in the optimal policy. We also 
showed that if the source is not energy harvesting, then transferring energy in the first slot is 
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Fig. 11. Capacity region of the multiple access channel with energy transfer. 

optimal. Next, we studied the capacity region of the Gaussian two-way channel. We showed 
that the boundary of the capacity region is achieved by policies that are given by a generalized 
version of two-dimensional directional water-filling algorithm. Finally, we studied the Gaussian 
multiple access channel. We showed that no energy transfer is needed if the priority of the first 
user is higher, and all of the energy needs to be transferred to the second user if the priority of 
the second user is sufficiently high. These results reveal new insights on how energy is optimally 
allocated in multi-user scenarios when wireless energy transfer is available as a new degree of 
freedom in network design. We remark that the analysis for finding the optimal policies in each 
multi-user setting can be extended for the cases when bi-directional energy transfer is allowed. 
In the two-hop relay setting, if bi-directional energy transfer is allowed, perfectly matching the 
energy profiles of the source and the relay nodes would be feasible and hence optimal: In this 
case, we collect energy arrivals of the source and the relay in a single energy queue and perform 
a single-user optimization. We then divide resulting power allocation equally for the source 
and the relay. Similarly, [l48l recently presented the extension of the analysis for two-way and 
multiple access channels when bi-directional energy transfer is allowed. 
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Appendix A 
Proof of Lemma [6] 

Consider two feasible power policies and energy transfer profiles (Pi, Pi, di) and (P2, P2, S2). 
Let us consider a new policy as a convex combination of these two policies, i.e., (P3, P3, 63) = 
A (Pi, Pi, (5i) + (1 — A)(P2, P2, (52) for < A < 1. First we show that this new policy is feasible: 

k k 

J2P3^ = Y1 ^^1* + (1 - (51) 

i=l i=l 

k k 

< A - 5u) + (1 - A) Y,iE^ - 52^) (52) 

i=l i=l 

k 

= J2iE,-6s.), k = l,...,T (53) 

i=l 

We use similar arguments for Psij^si and show that the policy (P3,P3,53) is feasible. 

Now, consider the upper comer points of the achievable rate regions for (Pi,Pi,<5i) and 
(P2,P2, S2). Since log(l + p) is concave in p, we have 

T T T 

log(l + P3i) > E + ^1^) + (1 - ^) + ^2.) (54) 

i=l 1=1 i=l 

T T T 

^log(l + P3.) > 5^ Alog(l + Fi,) + (1 - A) J]log(l + A.) (55) 

i=l i=l i=l 

This means that the new policy (P3,P3,<53) achieves a higher throughput for both users than 
the line connecting the two upper comer points under policies (Pi,Pi,<5i) and (P2,P2,52)- 
Therefore, the region C(E,E) is a convex region. 

Appendix B 
Proof of Lemma [8] 

Consider two feasible power policies and energy transfer profiles (Pi, Pi, di) and (P2, P2, ^2)- 
Let us consider a new policy as a convex combination of these two policies, i.e., (P3, P3, ^3) = 
A (Pi, Pi, (5i) + (1 — A)(P2, P2, <52) for < A < L Since the constraints in set are linear in the 
power vectors, it can be shown as in the proof of Lemma |6] in Appendix |A] that this new policy 
is feasible. 

Now, let Si be the pentagon created by the policy (Pi, Pj, <5j), for i = 1,2,3. Choose ti e 5*1 
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and t2 e S2 to form ts = Xti + (1 - X)t2 for < A < 1. We need to show that ^3 G S'3. We 
proceed as follows: 

hi = Xtu + (1 - X)t2i (56) 

T T 

< A J] log(l + Pi,) + (1 - A) ^ log(l + P2i) (57) 

i=l 1=1 
T 

<^log(l + APi, + (l-A)P2.) (58) 

2=1 

T 

= J]log(l + P3.) (59) 
1=1 

Similarly, we show ^32 < J2i=i^'^s{^ + -^sO- Finally 

tsi + ^32 = A(tn + t2i) + (1 - A)(t2i + ^22) (60) 

T T 

< A ^ log(l + Pu + Pu) + (1 - A) J] log(l + P2. + P2^) (61) 

i=l 1=1 
T 

< X;iog(l + A(Pi, + Pu) + (1 - A)(P2, + P2.) (62) 

i=l 
T 

= ^log(l + P3, + P3,) (63) 
i=l 

These inequalities show that £3 G S'3 since it satisfies the boundary conditions of S'3. Therefore, 
the region C(E,E) is a convex region. 
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